Skip to main content

Master Data Processing

Overview​

The Master Data Processing has two primary purposes:

  1. Storing detailed foundational data (meters, metering points, networks, contracts, etc.) to support downstream processes
  2. Providing foundational information to third-party systems

Supported Message Types​

The system supports the following Common Interface Model (CIM) IEC 61968-9 messages:

  • MeterConfig
  • MetrologyFunction
  • ConnectDisconnectFunction
  • MeterMultipliers
  • Lifecycle
  • MasterDataLinkageConfig
  • UsagePointConfig
  • CustomerAgreementConfig

Process Flow​

Upload Master Data

  • Performed by third-party systems through integration

Store Master Data

  • Maps incoming message fields against system data objects
  • Stores mapped data in the system
  • Creates new datasources when they don't exist
  • Creates new tags (properties) or updates existing ones

Send Response Message

  • Returns confirmation of processed message to the system that initiated the message
  • Configuration available to make this optional based on requirements

Business Rules & Customization Points​

Data Mapping Rules​

  • Customization : Partners can define custom field mappings through transformation configurations

Data Validation Rules​

  • Standard_Tariff_Name_Validation : Ensures there is a TimeSlice Group defined in the system with the same name as tariff name in the message.
  • Customization : The TimeSlice Group names are configurable in the system. The Tariff_Name_Validation rule could be customized to use different message field to get the tariff name.

Linkage Rules​

  • Standard_Update_Linkage_Storage : Manages relationships between different data entities (e.g. Meter and Metering_Point)
  • Customization : The linkage structure can be customized for different data models

Implementation Considerations​

Data Quality

  • Ensure source systems provide complete and accurate data
  • Implement pre-validation where possible before data reaches the EDM

Performance Optimization

  • Batch processing of master data is recommended for large volumes
  • Consider implementing data change detection to minimize processing

Monitoring & Troubleshooting​

The following dashboard widgets are available for overview of Meters and its switched-off statuses:

  • Total Orphan Meters
  • Orphan Meters
  • Total Non-Communicating Meters
  • Non-Communicating Meters
  • Total Switched Off Meters
  • Switched-Off Meters

Configuration Components​

Flow Designs​

  • Standard_Meter_Config_Flow
  • Standard_Usage_Point_Config_Flow
  • Standard_Customer_Agreement_Config_Flow
  • Standard_Master_Data_Linkage_Config_Flow
  • Ingest_MasterData_Unlinkage_Config_Flow

Transformation Configurations​

  • Meter_Config_Tc
  • Usage_Point_Config_Tc
  • Customer_Agreement_Config_Tc
  • Master_Data_Linkage_Config_Tc

Market Adapter Configurations​

  • Meter_Config_Ma [JSON]
  • Usage_Point_Config_Ma [JSON]
  • Customer_Agreement_Config_Ma [JSON]
  • Master_Data_Linkage_Config_Ma [JSON]